Multicollinearity and maximum entropy estimators
نویسنده
چکیده
Multicollinearity hampers empirical econometrics. The remedies proposed to date suffer from pitfalls of their own. The ridge estimator is not generally accepted as a vital alternative to the ordinary least−squares (OLS) estimator because it depends upon unknown parameters. The generalized maximum entropy estimator depends upon subjective exogenous information. This paper presents a novel maximum entropy estimator that does not depend upon any additional information. Monte Carlo experiments show that it is not affected by any level of multicollinearity and dominates the OLS estimator uniformely. The same experiments provide evidence that it is asymptotically unbiased and its estimates are normally distributed. Quirino Paris is a professor at the University of California, Davis and a member of the Giannini Foundation. I am indebted to Michael R. Caputo and Art Havenner for stimulating discussions that have improved an earlier version of this paper. All errors are mine. Citation: Paris, Quirino, (2001) "Multicollinearity and maximum entropy estimators." Economics Bulletin, Vol. 3, No. 11 pp. 1−9 Submitted: July 29, 2001. Accepted: August 17, 2001. URL: http://www.economicsbulletin.com/2001/volume3/EB−01C20002A.pdf
منابع مشابه
Generalized Maximum Entropy Estimators: Applications to the Portland Cement Dataset
Consider the linear regression model y = X + u in the usual notation. In many applications the design matrix X is frequently subject to severe multicollinearity. In this paper an alternative estimation methodology, maximum entropy is given and used to estimate the parameters in a linear regression model when the basic data are ill-conditioned. We described the generalized maximum entropy (GME) ...
متن کاملLiu-Type Logistic Estimators with Optimal Shrinkage Parameter
Multicollinearity in logistic regression affects the variance of the maximum likelihood estimator negatively. In this study, Liu-type estimators are used to reduce the variance and overcome the multicollinearity by applying some existing ridge regression estimators to the case of logistic regression model. A Monte Carlo simulation is given to evaluate the performances of these estimators when t...
متن کاملEstimation under Multicollinearity : Application of Restricted Liu and Maximum Entropy Estimators to the Portland Cement Dataset
2. Various Methods of Estimation under Severe Multicollinearity Conditions: In what follows, we give a brief account of some important methods of estimation under severe multicollinearity conditions: (i). The Restricted Least Squares (RLS) Estimator of β : If we can put some restriction on the linear combination of regression coefficients such that , R r β = then the RLS estimator of β denoted ...
متن کاملJackknifed Liu-type Estimator in Poisson Regression Model
The Liu estimator has consistently been demonstrated to be an attractive shrinkage method for reducing the effects of multicollinearity. The Poisson regression model is a well-known model in applications when the response variable consists of count data. However, it is known that multicollinearity negatively affects the variance of the maximum likelihood estimator (MLE) of the Poisson regressio...
متن کاملComparison of Maximum Entropy and Higher-Order Entropy Estimators
We show that the generalized maximum entropy (GME) is the only estimation method that is consistent with a set of five axioms. The GME estimator can be nested using a single parameter, α, into two more general classes of estimators: GME-α estimators. Each of these GME-α estimators violates one of the five basic axioms. However, smallsample simulations demonstrate that certain members of these G...
متن کامل